ALGEBRAIC ELEMENTS AND INVARIANT SUBSPACES 
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Abstract. We prove that if a completely non-unitary contraction T 
in L{H) has a non-trivial algebraic element h, then T has a non-trivial 
invariant subspace. 



Introduction 

One of the most interesting open problems is the invariant subspace prob- 
lem. The invariant subspace problem is the question whether the following 
statement is true or not: 

Every bounded linear operator T on a separable Hilbert space H of di- 
mension > 2 over C has a non-trivial invariant subspace. 

We know that the invariant subspace problem is solved for all finite di- 
mensional complex vector spaces of dimension at least 2. Thus, in this note, 
H denotes a separable Hilbert space whose dimension is infinite. Since it 
is enough to consider a contraction T, i.e., ||r|| < 1 on i?, in this note, T 
denotes a contraction. 

First, we focus on completely non-unitary contractions to use a property 
of a multiplicity- free operator of class Co, and we consider algebraic elements 
with respect to a completely non-unitary contraction T introduced in [2]. 

If T is a contraction, then 

(Case 1) T is a completely non-unitary contraction with a non-trivial 
algebraic element, or 

(Case 2) r is a completely non-unitary contraction without a non-trivial 
algebraic element, that is, every non-zero element in H is transcendental 
with respect to T, or 

(Case 3) T is not completely non-unitary. 

In this note, we discuss the invariant subspace problem for operators of 
(Case 1) or (Case 3). By using a classification of the invariant subspaces of 
a multiplicity-free operator of class Co ([!]), in Theorem 12.31 we prove that, 
for a completely non-unitary contraction T, if T has a non-trivial algebraic 
element h, then T has a non-trivial invariant subspace. By Theorem 12.31 
we conclude that every Co-operator has a non-trivial invariant subspace 
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(Corollary 12. 4p . It follows that every nilpotent operator has a non-trivial 
invariant subspace (Corollary I2.5p . 

In Corollary 12.71 we prove that if Ti is not a completely non-unitary 
contraction, then Ti also has a non-trivial invariant subspace. 

Thus, we answer to the invariant subspace problem for the (Case 1) and 
(Case 3) in Theorem l2.3l and Corollary 12 . 71 respectively. Therefore, to answer 
to the invariant subspace problem, it suffices to answer for (Case 2). 

We do not consider operators of (Case 2) in this note, and leave as a 
question; 

Question. Suppose that every non-zero element in H is transcendental 
with respect to T. Then, does the operator T have a non-trivial invariant 
subspace? 

1. Preliminaries and Notation 

In this note, C, M and L[H) denote the set of complex numbers, the 
(norm) closure of a set M, and the set of bounded linear operators from 
H to H where H is a separable Hilbert space whose dimension is infinite, 
respectively. 

If T € L{H) and M is an invariant subspace for T, then T\M is used to 
denote the restriction of T to M. 

1.1. A Functional Calculus. Let be the Banach space of all (complex- 
valued) bounded analytic functions on the open unit disk D with supremum 
norm [3j. A contraction T in L{H) is said to be completely non-unitary 
provided its restriction to any non-zero reducing subspace is never unitary. 

B. Sz.-Nagy and C. Foias introduced an important functional calculus for 
completely non-unitary contractions. 

Proposition 1.1. Let T € L{H) be a completely non-unitary contraction. 
Then there is a unique algebra representation from H°° into L{H) such 
that : 

(i) ^*t(1) = Ih, where Ih G L(H) is the identity operator; 

(ii) ^t{9) = T, ifg{z) = z for all z E D; 

(Hi) is continuous when H°° and L{H) are given the weak*- 
topology. 

(iv) is contractive, i.e. \\^t{u)\\ < ||u|| for all u € H°° . 
We simply denote by u{T) the operator $r(u). 

B. Sz.- Nagy and C. Foias [3] defined the class Cq relative to the open 
unit disk D consisting of completely non-unitary contractions T on H such 
that the kernel of $t is not trivial. If T € L{H) is an operator of class Cq, 
then 

ker $r = {w G : u{T) = 0} 
is a weak*-closed ideal of , and hence there is an inner function gener- 
ating ker (^T- The minimal function mx of an operator T of class Cq is the 
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generator of ker ^t, that is, 

(1.1) kei^T = mTH°°. 

1.2. Algebraic Elements. To provide a sufficient condition for (non-trivial) 
invariant subspaces, we will use the notion of algebraic elements for a com- 
pletely non-unitary contraction T in L[H). 

Definition 1.2. [2j Let T € L{H) be a completely non-unitary contraction. 
An element /i of is said to be algebraic with respect to T provided that 
9{T)h = for some 9 € H°° \ {0}. If /i 7^ 0, then h is said to be a non-trivial 
algebraic element with respect to T. 

If /i is not algebraic with respect to T, then h is said to be transcendental 
with respect to T. 

If is a closed subspace of H generated by {6j G H : i = 1,2,3, ■ ■ ■}, then 
B will be denoted by VJ^i ^i- 

1.3. Blaschke Products. For each a G D, the Blaschke factor ba is a 
function defined by 

, , , \a\ a - z ^ 

Oa(2) = — :; —, z eu, 

a \ — az 

if a / 0, and hQ{z) = z for z G D. We recall that a Blaschke Product is a 
function of the form 

Kz)=\{ba,{z), z€D, 
i 

where {aj}°2,o ^ sequence in D such that YlijO- ~ < 

A function /i : D ^ {0, 1, 2, • • •} is said to be a Blaschke function if 

^(a)(l — |a[) < 00. 
If 6 is a Blaschke Product, then we have a Blaschke function ^ such that 

= n (^"(^))'^^"^ 

where ^(a) represents the multiplicity of a as a zero of b, and this Blaschke 
Product h will be denoted by b^. Recall that a singular inner function is 
determined by a positive finite measure v on 9D, singular with respect to 
Lebesgue measure, via the formula 

Sy{X) = exp(- / |^dz^(0)i 

for A G D (P). 

If 6 is an inner function, then there exist a Blaschke product b, a singular 
inner function s, and a constant 7, I7I = 1, such that 

9 = -fbs. 

Let us recall that the set of positive finite measures on 9D has a lattice 
structure with respect to the following relation; < u' <^ i^(^) < ^'i^) 
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for every Borel subset A of (9D, and the set of Blaschke functions can also 
be organized as a lattice with respect to the following relation; < fi' 4^ 
m(^) ^ l^'i^) fo'^ every z G D [T]. 

Let 9 and 6' be two functions in H°°. We say that 6 divides 6' {or 6\9') if 
6' can be written as 9' = 6 ■ cp for some <j) G We will use the notation 

9 = 9' \i 9 and 9' are two inner functions that differ only by a constant 
scalar factor of absolute value one. Thus, the relations 9\9' and 9'\9 imply 
that 9 = 9'. 

Proposition 1.3. (^) Let /i and fi' be Blaschke functions, v and v' singular 
measures on dD, 7 and 7' complex numbers of absolute value one, and set 
9 = 'yb^Su, 9' = ib^iSyi. 

Then, 9\9' if and only if < fi' and v <v' . 

2. The Main Results 

We recall that an operator T ia said to be multiplicity-free if T has a cyclic 
vector. The invariant subspaces of a multiplicity-free operator of class Co 
have a classification as following ; 

Proposition 2.1 ([IJ, Theorem 3.2.13). For every operator T of class Cq, 
the following assertions are equivalent; 

(i) T is multiplicity- free. 

(ii) For every inner divisor (j) of tut (that is, 4> is an inner function 
such that (j)\mT ), there exists a unique invariant subspace K for T such that 
mT\K = 4>- 

If T is multiplicity-free, then the unique invariant subspace in (ii) is given 
by K = ker (t){T). 

Note that mj- always has two trivial inner divisors 0i = 1 and (f)2 = tut. 

Proposition 2.2. Let T : H ^ H be a multiplicity-free operator of class 
Co and (p be an inner divisor of mx- 

If (j) is not a trivial inner divisor, then ker(/>(T) is a non-trivial invariant 
subspace for T . 

Proof. Suppose \ev (f){T) = H. Then, by equation mT\(t>. Since (p is 

an inner divisor of my, (p = nriT which is a contradiction. 

Suppose that ker(/>(T) = {0}. Since (p is an inner divisor of m-j-, 

(2.1) mr = (pip, 

for a function 93 G H°°. Since mT{T) = (p{T)ip{T) = and ker(p{T) = {0}, 
(p{T) = 0. Thus, by equation (11. 1[) . 

(2.2) mT\ip. 

By equation (j2.ip and (12. 2p . we have = tut, and equation (j2.ip implies 
that (p = 1 which is a contradiction. 

□ 
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Theorem 2.3. Let T G L{H) he a completely non-unitary contraction. 

If T has a non-trivial algebraic element h, then T has a non-trivial in- 
variant subspace. 

Proof. Suppose that T has a non-trivial algebraic element h. Then, there is 
a non-zero function 9 G such that 9{T)h = 0. 
Let M = V^=o2'"/i, and Ti = T\M. 

Since e{T){T''h) = T''{9{T)h) = for any n = 0,1,2,- • •, e{Ti) = 0. 
Thus, the operator Ti : M ^ M is a multiplicity- free operator of class Cq. 
If rriTi = 1, then, by Proposition ll.il 

(2.3) mT,{Ti)h = h. 

Since mTj(Ti) = 0, equation l\2.3h implies that h = which is a contradic- 
tion. Thus, 

(2.4) mr, + 1. 

By Proposition 12.11 foi^ every inner divisor of mTi, there exists a unique 
invariant subspace K(^= ker</)(Ti)) for T\. 

By Proposition [221 if </> is not a trivial inner divisor of txitx > then ker (j){Ti) 
is a non-trivial invariant subspace for Ti. Note that ker0(Ti) is also a non- 
trivial invariant subspace for T. 

If rriTi has no non-trivial inner devisors, then, by Proposition 11.31 and 
()2.4p . must be a Blaschke factor. Then, niTi = i-4z ^ D where 

a is a complex number in D, and in this case we clearly have mTi\{z — a). 
Therefore, 

(z - a) G ker = {n G : u{Ti) = 0}. 

Thus, (r — al}{)h = (Ti — alH)h = and so h is an eigenvector of T. Since 
h ^ and diuiH > 2, the closed subspace M(= y^^^T^-h) generated by 
the eigenvector /i is a non-trivial invariant subspace for T. 

□ 

Corollary 2.4. Every CQ-operator has a non-trivial invariant subspace. 

Corollary 2.5. Every nilpotent operator has a non-trivial invariant sub- 
space. 

Recall that an operator is subnormal if it has a normal extension. Thus, 
every normal operator is trivially subnormal. 

Proposition 2.6. H] 

Every subnormal operator has a non-trivial invariant subspace. 

Thus, we have the following well-known result; 

Corollary 2.7. // T is not a completely non-unitary contraction, then T 
has a non-trivial invariant subspace. 
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Proof. Since T is not a completely non-unitary contraction, there is a re- 
ducing subspace M{y^ {0}) for T such that T\M is a unitary operator. 

If M is a non-trivial reducing subspace for T, then it is done, li M = H, 
then T is unitary, and so T is subnormal. By Proposition 12.61 it is proven. 

□ 
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